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Abstract 

Collective dynamics result from interactions among noisy dynamical components. Ex- 
amples include heartbeats, circadian rhythms, and various pattern formations. Because 
of noise in each component, collective dynamics inevitably involve fluctuations, which 
may crucially affect functioning of the system. However, the relation between the fluc- 
tuations in isolated individual components and those in collective dynamics is unclear. 
Here we study a linear dynamical system of networked components subjected to indepen- 
dent Gaussian noise and analytically show that the connectivity of networks determines 
the intensity of fluctuations in the collective dynamics. Remarkably, in general directed 
networks including scale-free networks, the fluctuations decrease more slowly with the 
system size than the standard law stated by the central limit theorem. They even remain 
finite for a large system size when global directionality of the network exists. Moreover, 
such nontrivial behavior appears even in undirected networks when nonlinear dynamical 
systems are considered. We demonstrate it with a coupled oscillator system. 
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1 Introduction 



Understanding fluctuations in dynamically ordered states and physical objects, which consist 
of networks of interacting components, is an important issue in many disciplines ranging from 
biology to engineering. When each constituent component of a system is noisy due to, e.g., 
thermal fluctuations, it generally occurs that the entire system collectively fluctuates in time. 
Such collective fluctuations may be advantageous or disadvantageous in functioning of the sys- 
tems depending on situations. For example, reduction in noise is likely to improve information 
processing in retinal neural networks [IrS]. Precision of biological circadian clocks [SHS] may be 
improved by reduction in collective fluctuations (i.e., fluctuations in collective activities). On 
the other hand, maintaining a certain amount of fluctuations in an ordered state is advantageous 
for stochastic resonance [9] and Brownian motors [TO] . 

Despite the relevance of collective fluctuations in a variety of systems, theoretical frameworks 
that formulate collective fluctuations are missing. The central limit theorem states that, if the 
dynamical order is simply the averaged activity of noisy components, the standard deviation 
of the collective fluctuation would decrease with the number N of noisy components as N~ l l 2 . 
However, scaling is unclear in systems of interacting components. Clarifying the property of 
collective fluctuations in such systems will give us insights into the mechanisms and design 
principles underlying the regulation of noise in, for example, living organisms and chemical 
reactions, and also into possible controls of fluctuations in collective dynamics. 

In this study, we analyze an ensemble of components subjected to independent Gaussian 
noise that interact on general networks, including complex networks and regular lattices. We 
first consider a linear dynamical system, which can be regarded as linearization of various 
systems, such as networks of periodic or chaotic oscillators [IHEI2], the overdamped limit of 
elastic networks [TB] , a consensus problem treated in control theory [T3| . We show that collective 
fluctuations are determined by the connectivity of networks. It turns out that the scaling iV -1 / 2 
is the tight lower bound, which is obtained for undirected networks. General directed networks 
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yield a slower or nonvanishing decay of collective fluctuations with an increase in N. We then 
argue such nontrivial behavior appears even in undirected networks when nonlinear systems 
are considered. In particular, we show that linearization of coupled nonlinear oscillator systems 
on undirected media yields linear dynamics on asymmetric networks, such that the slow decay 
of the collective fluctuation is relevant. 

2 Model and analysis 

Consider a network of N components obeying 

N 

ii = Yl w v( x i ~ x i) + V^&(*)> (l < * < W), (1) 

3=1 

where Xi is the state (or the position) of the ith component, y/Dl is the intensity of noise, 
& is the independent Gaussian (generally colored) noise, and Wij is the intensity of coupling 
and can be also regarded as originating from the Jacobian matrix of underlying nonlinear 
dynamical systems such as coupled oscillator systems that we consider later. We allow negative 
weights and asymmetric coupling; Wij can be negative or different from Wji. Equation (JTJ is a 
multivariate Ornstein-Uhlenbeck process [T5JIT6]. 
For convenience, we represent Eq. (JT]) as 

x = —Lx + p, (2) 

where x = {x\ ... x^) T (T denotes the transpose), p = (y/Di£i ■ ■ ■ y/D N ^ N ) T , and L = (L^) 
is the asymmetric Laplacian defined by = 6^ J2i'^i w a' ~ (1 — ^ij) w ij [I3IIB]- L always has 
a zero eigenvalue with the right eigenvector u = (1 ... 1) T , i.e., Lu = 0. This eigenvector 
is associated with a global translational shift in state x and corresponds to the fact that such 
a shift keeps Eq. (JTJ) invariant. We assume the stability of the ordered state represented by 
X\ — . . . — xn in the absence of the noise (i.e., Dj = for all i); the system relaxes to the ordered 
state from any initial condition. This is equivalent to assuming that the real parts of all the 
eigenvalues of L are positive except for one zero eigenvalue, i.e., = Ai < ReA2 < . . . < ReA^. 
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This is a nontrivial condition for general networks with negative weights. However, for networks 
with only non-negative weights, i.e., Wy > (1 < i,j < N), this property holds true when the 
network is strongly connected or all the nodes are reachable by a directed path from a single 
node [HmniEO] . 

We are concerned with collective fluctuations in dynamics given by Eq. ([1]). To quantify 
their intensity, we decompose x as 

x(t) = y(t)u + p(t). (3) 

y(t) describes the one-dimensional component along u, and p(t) is the (N — 1) -dimensional 
remainder mode. Note that y(t) = vx(t), where the row vector v = (v\...vn) is the left 
eigenvector of L corresponding to the zero eigenvalue, i.e., vL = 0, and is normalized as 
vu = 1, i.e., J2iLi v i = 1 ( see Appendix A for detailed descriptions). We call y{t)u the 
collective mode. In the absence of noise, the dynamical equation for y(t) is given by 

y = vx = —vLx = 0. (4) 

Therefore, y(t) is a conserved quantity of the dynamics. The remainder mode p(t) is associated 
with relative motions among the components. Because of the stability assumption, p{t) asymp- 
totically vanishes with characteristic time (Re A2)" 1 . Therefore, all the values of Xi (1 < % < N) 
eventually go to the same value y that is determined by the initial condition, i.e., y = vx(0). 
In the presence of noise, we obtain 

N 

y = vx = v(-Lx + p) = vp = ^2 Viy/D~i£i(t). (5) 

i=i 

Because & is the independent Gaussian noise, this equation reduces to 



N 



J2v!D^(t)=aat), (6) 
\ i=i 



where £(£) is the Gaussian noise having the same statistical property as that of each 
Thus, y(t) performs the Brownian motion with effective noise strength a and is unbounded. 



The remainder mode p(t) fluctuates around zero because of its decaying nature. Therefore, 
the long-time behavior of Xi(t) — y(t) + pi(t) is approximately described by a single variable 
y(t) for any i. We denote as a, which depends on the structure of the network, the intensity of 
collective fluctuations, a can be calculated for given network. 

In practice, the average activity of the population, x = Y^i=i x i/N, but not the activity 
at individual nodes, may be observed. Because x = y + ^ i= iP%/N and YliLiPi/N can be 
neglected in a long run, a also characterizes the fluctuations of x. 

3 Collective fluctuations in various networks 
3.1 General properties 



We assume for simplicity that Di = 1 (1 < i < N) so that a = yYliLi v h ^ * s straightforward 
to extend the following results to the case of heterogeneous D^. The vector v is uniform, i.e., 
Vi = 1/N (1 < i < N) if and only if = A;° ut (1 < i < N), where kf 1 = J2f=i w ij and 
k° ut = J2j f =i w ji are indegree and outdegree, respectively [IS] . Undirected networks satisfy this 
condition. In this case, we obtain a = iV" 1 / 2 , which agrees with the central limit theorem. 
The normalization condition ^2f =1 V{ = 1 guarantees that a > A r_1//2 for any v. Therefore, 
undirected networks are the best for reducing collective fluctuations. In the case of directed 
or asymmetrically weighted networks, is generally heterogeneous, and a > N^ 1 ^ 2 . We will 
show later that this is also the case for nonlinear systems on undirected networks. When the 
weight Wij is nonnegative for any i and j, the Perron-Frobenius theorem guarantees that Vi is 
nonnegative for all i [21]. In this case, we obtain 

4= < * < 1- (7) 

The case a = 1 is realized by a feedforward network, in which a certain component i has no 
inward connection (i.e., k 1 ? = 0). Then, v io = 1 and v i = for i ^ i , which yields a = 1 
irrespective of N; the collective fluctuations are not reduced at all with an increase in N. When 
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negative weights are allowed, some elements of v may assume negative values. Then, a may be 
larger than 1, in which case collective fluctuations are larger than individual noise. 

We note that a 2 is the so-called inverse participation ratio [22]. a~ 2 can be interpreted 
as the effective number of components that participate in collective activities; the remaining 
components are slaved. 

3.2 Directed scale-free networks 

We demonstrate our theory by using some example networks. First, we consider directed scale- 
free networks, schematically shown in Fig. [TJ^a) in which kf 1 and /c° ut independently follow the 
distributions p(k m ) oc k~ lin and p(k out ) oc k~ lout , respectively. By assuming that the values of 
Vi of adjacent nodes are independent of each other, we obtain 

TV TV 
3=1 3=1 

where 



Y^TV , 

tV tV 

Therefore, 

'„out / jLin 



(9) 



(10) 



This approximation is sufficiently accurate for uncorrelated networks [TS]. For p(k m ) oc k~ lin 
and p(k ont ) oc k~ lout , we obtain 

Lout / Lin 

v .« Ki (ii) 



and 



a 



2 ■ 



(12) 



\ N (k out ) 2 ((k^y 1 )' 

where (•) is the ensemble average. When 7 out < 2, a winner-take- all network is generated [2"5jT2"l] . 
and there exists a node i such that k° ut = O(N) and Vi = 0(1). When 7 out > 2, the extremal 
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criterion results in the maximum degree increasing; with N as jVV(7out-i) > 2 ) 

m many 



networks 



. Then, we obtain 



(k ont y 



(Tout < 2), 
(Tout = 2), 
(Tout > 2), 



iV" 7out+3 , (Tout < 2), 

JV(-7o»t+3)/(7out-l) j (2 < 7out < 3), 




(13) 



In AT, 
0(1), 



(Tout = 3), 
(Tout > 3), 



(14) 



and 



Therefore, we obtain 



(k in y 1 ),((k-y 2 ) = o(i). 



(15) 



it < 2) 
= 2) 



/out 



r i, a 

1/lnJV, ( 7 c 
c <! jV-^out-i)" 1 , (2< 7out <3), (16) 
iV- 1 /2(i nA r)i/2 ) ( 7out = 3 ), 

iV" 1/2 , (Tout > 3). 

The fairly heterogeneous case 7 out < 2, in which the average outdegree diverges as iV — > oo, 

effectively yields a feedforward network. The case 7 out > 3, where the second moment of the 

outdegree converges for N — > oo, reproduces the central limit theorem. The latter result is 

shared by the directed version of the conventional random graph. The case 2 < 7 out < 3 

yields a nontrivial dependence of a on N. In Fig. EJja), we compare the scaling exponent /3, 

where a oc iV~ /3 obtained from the theory (solid line; Eq. (TIE]) ) and numerical simulations of 

the configuration model [23l|27] with the power-law degree distribution with minimum degree 3 

(open circles). The fitting procedure is explained in Fig. EJ^b). Equation (JTBjl roughly explains 

numerically obtained values of /3. 

3.3 Directed lattices 

The second example is the directed one-dimensional chain of iV nodes depicted in Fig. QJb). 

We set w i+u = 1 (1 < i < N - 1), = e (2 < i < N), and w jti = (j ^ i - 1, i + 1). For 



S 



this network, by solving vL = 0, we analytically obtain 

(1 - eV" 1 



1 - 

and 



1 < i < N) (17) 



'l-el + e* 

- = "TT7I^- < 18 > 

Values of a for various e and N are plotted by solid lines in Fig. |3]^a). Interestingly, for e ^ 1, 
liniTv^oo c = — e )/(l + e )i a ^ s nonvanishing. We have also analytically derived a for 
directed d- dimensional lattices (see Appendix B). The results for the two-dimensional lattice 
depicted in Fig. []Jc) are plotted by solid lines in Fig. [21(b) . To confirm our theory, we also 
carried out direct numerical simulations of Eq. ([T]) with Gaussian white noise for these directed 
lattices. The results indicated by circles in Fig. [3] indicate an excellent agreement with our 
theory. 

A similar result is obtained for the Cayley tree (see Appendix C). 

4 Oscillator dynamics 

As an application of our theory to nonlinear systems, we examine noisy and rhythmic com- 
ponents. As a general, tractable, yet realistic model, we consider a network of phase oscilla- 
tors [HIEHIEH] , whose dynamical equation is given by 

N 

<p i = u i + Y,A ] f{<P ] -<Pi) + \^D l Ut), (l<i<N), (19) 
i=i 

where <pi G [0, 2ir) and Ui are the phase and the intrinsic frequency of the ith oscillator, respec- 
tively, Aij is the intensity of coupling, and /(•) is a 27r-periodic function. We assume that, in the 
absence of noise, all the oscillators are in a fully phase- locked state, i.e., <fri(t) = Qt + tpi, where 
Q and ipi are the constants derived from 0j = Q (1 < i < N). Under sufficiently weak noise, 
we can linearize Eq. ffTQ"]) around the phase-locked state. Letting Xi = (pi — (ipi + Qt), we obtain 
Eq. (DO), where Wij = Aijf'(ipj — ipi) is the effective weight. The validity of linearizing Eq. (TT9"j) 
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for small noise intensity is tested by carrying out direct numerical simulations of Eq. f[T§j) with 



uoi = lu (1 < i < N) and f((f>) = sin0. The relationship a ~ y^2 i=1 DiV 2 is satisfied in the 
directed one- and two-dimensional lattices, as shown in Fig. Hl^a) and (b), respectively. 

When there is some dispersion in ipi in a phase-locked state, the relation a ~ N^ 1 ^ 2 may 
be violated even in undirected networks. This is because the effective weight is generally 
asymmetric (i.e., Wij ^ Wji) unless /(•) is an exact odd function. In reality, /(•) is usually 
not an odd function [TT|l29l[3T] . As an example, we consider target patterns (i.e., concentric 
traveling waves), which naturally appear in spatially extended oscillator systems [TT|l3"2]. We 
carry out direct numerical simulations of Eq. (I19[) on the two-dimensional undirected lattice 
with linear length vW = 50, f(4>) = sin(0 — a) + sin a, and a = it /A. Such a function may be 
analytically derived from a general class of coupled oscillators [TT] , and it approximates a variety 
of real systems [29 | l3T j l3"3] . We set u>i = uq + Au (Au > 0) for 4 x 4 pacemaker oscillators in the 
center and Ui = uq for the other oscillators, where uq is arbitrary and set to 1. A target pattern 
is formed when there is sufficient heterogeneity in the intrinsic frequency [TT]. A region with 
high intrinsic frequency acts as a pacemaker. A snapshot for Au = 0.3 is shown in Fig. |5(a). 
As observed, the radial phase gradient is approximately constant, which makes the effective 
network similar to the directed two-dimensional lattice depicted in Fig. HJc). Therefore, as 
shown in Fig. Efb), Vi calculated numerically decreases almost exponentially with the distance 
from the center. We find that the dependence of a on N, shown in Fig. 13(c), is similar to that 
for directed lattices. 

We emphasize that the network is undirected (i.e., = Ajj). We have also theoretically 
confirmed that our results are valid for the continuous oscillatory media under spatial block 
noise, which models chemical reaction-diffusion systems (see Appendix D). 

5 Conclusions 

In summary, we have obtained the analytical relationship between collective fluctuations and 
the structure of networks. In undirected networks, the fluctuations decrease with the system 
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size N as iV -1 / 2 ; this result agrees with the central limit theorem. In general directed networks, 
the collective fluctuations decay more slowly. For example, in directed scale-free networks, we 
obtain N~@ with < (5 < 1/2. In networks with global directionality, the fluctuations do not 
vanish for a large system size. We have also demonstrated that such nontrivial dependence 
appears even in undirected networks when nonlinear systems are considered. We have focused 
on systems of nonleaky components. Results for coupled leaky components will be reported 
elsewhere. 

Our results are distinct from earlier results demonstrating the breach of the central limit 
theorem due to heavy-tailed noise [34J or the correlation between the noise in different elements 
[35l[36]. 

Finally, because our theory is based on a general linear model, it can be tested in a variety of 
experimental systems. An ideal experimental protocol is provided by photo-sensitive Belousov- 
Zhabotinsky reaction systems, in which the heterogeneity, noise intensity, and system size can 
be precisely controlled by light stimuli [22] • Experiments with coupled oscillatory cells, such as 
cardiac cells and neurons under an appropriate condition, would be also interesting. 
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Appendix A: Derivation of the collective mode 

To derive the collective mode y(t)u, we note that there exists a nonsingular matrix P such 
that L = P~ l LP is its Jordan canonical form [T71I2T] . We assume that L\\ — \\ — and 
Lu = Ln = (2 < i < N) without loss of generality. The submatrix (Lij) (2 < i,j < N) 
corresponds to the N — 1 modes with the eigenvalues A2, . . . , Ajv- Because the first column of 
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LP = PL is equal to (0 ... 0) T , the first column of P is equal to the right eigenvector of L 
corresponding to Ai = 0, i.e., u = (1 ... 1) T . Because the first row of P~ l L = LP" 1 is equal 
to (0 ... 0), the first row of P~ l is equal to the left eigenvector of L corresponding to Ai = 0, 
i.e., v — (vi Vi ... Ujv). The normalization is given by Y2iLi v i = 1- Under the variable change 
(y y T ) = P~ 1 x G M. N , where y G R and y r G R^ -1 , the coupling term is transformed into 
— L(y y T ). Then, in the absence of the dynamical noise, y = J2i= 

conserved quantity, 

which is the collective mode. p(t) in Eq. ([3]) is given by P T y r , where P r is the N by N — 1 
matrix satisfying P = (u P r ). 

Appendix B: Collective fluctuations in regular lattices 
with arbitrary dimensions 

Consider a directed two-dimensional square lattice with a root node. As depicted in Fig. QJc), 
the edges descending from the root node and those approaching the root node in terms of the 
graph-theoretic distance are given weight 1 and e (0 < e < 1), respectively. We define layers 
such that the layer I (< £ max ) is occupied by the nodes whose distance from the root node 
is equal to I. Layer contains the root node only, and layer £ (> 1) contains A£ nodes. We 
consider the lattice within a finite range specified by £ < ^ max . Note the difference from the 
case of the one- dimensional chain examined in the main text (Fig. HJb)), where the root node 
is located at the periphery of the chain. However, the scaling of a is not essentially affected by 
this difference. 

The symmetry guarantees that the four nodes in layer 1 have the same value of Uj. Consider 
a node in Fig. []Tc) that is labeled 2 and adjacent to two nodes labeled 1. There are four such 
nodes. The equation in vL = corresponding to this node is given by (2 + 2e)v 2 = 2ev\ + 2t> 3 . 
The other four nodes labeled 2 in Fig. [T^c) yield a different equation (1 + 3e)^2 = ev\ + 3^3. 
Similarly, we obtain (2 + 2e)v£ = 2eve~i + 2t^ +1 for all but four nodes in layer £. The other four 
nodes satisfy (1 + 3e)v£ = ev£_i + 3vg + i. Despite this inhomogeneity, v e oc e e satisfies all these 
equations. By counting the number of nodes in each layer, the properly normalized solution is 
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given by 



and 



where 



ri 2) (el 



(0 < £ < £ max ), 



a 



T, 



(2) 



T^ 2) (e) 



(S.20) 



(S.21) 



T, 



(2) 



i=i 



(S.22) 



{1-zY 

The difference between the one- and two-dimensional cases lies in the number of nodes in each 
layer, which affects the normalization of vg and hence the value of a . In the limit of a purely 
feedforward network, a is independent of the system size, i.e., \im e ^o< J =1- I n the case of 
undirected networks, the central limit theorem is recovered, i.e., lim e _»i a = iV" 1 / 2 . In the limit 
of infinite space, we obtain 

lim a = - 



For a general dimension d, layer has a single root node, and layer 



(S.23) 



has 



N 



y/' 



j^ id '\(d-d')\(d'-iw-d')\ 

nodes, d' is the number of coordinates among the d coordinates to which nonzero values are 
assigned, and the factor 2 d ' takes care of the fact that reversing the sign of any coordinate does 
not change the layer of the node. Similar to the case of the two-dimensional lattice, the value 
of i>i for any node in layer £ in a <i-dimensional lattice, denoted by vi , is given by 



Tl d) (e) 



(0<£< W), 



where 



r£L(*) = i + Z>i 



(<*). 



(S.24) 



(S.25) 
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From Eq. ( lS.24p . we obtain 



a 



T (d) (e2) 
Tl d) (e) 



(S.26) 



Note that lim^o " = 1 and lim e ^i a = N 1//2 . In the limit £ max — > oo, Eq. (1S.25|) becomes 



lim To (z 



i + f y {e - 1)l / 

^ d'Ud - d')\ ^ (d> - 1)\(£ - d')\ 

d'=i K ' i=d' K * K ' 

d' 



d\ 



^ d'Ud-d'V. 

'=1 v ' 



1 - z 



1 + z 
1 - z 



(S.27) 



Substituting Eq. flST27jl into Eq. (ET26j) yields 



lim a 



(1 + e) 3 



d/2 



(S.28) 



Appendix C: Collective fluctuations in the Cayley tree 

Consider a Cayley tree with degree k and a specific root node. We assume that the maximum 
distance from the root node is equal to £ max - The edges descending from the root node and 
those approaching the root node are assigned weight 1 and e, respectively. The exact value of 
Vi in layer £, denoted by vg without confusion, is obtained via 



[! + (*- 1) e] v e = e^_! + (fc - 1) v i+1 , {£ > 1). 



(S.29) 



By solving Eq. (IS.29p . we obtain 



1 - (e£;) w+1 



From Eq. ( 1S.30[) . we obtain 



a 



l-(efc) 1 - (e 2 A;) £max+1 



1 - (ekf™^ 1 V 1 - {e 2 k) 



(S.30) 



(S.3i; 



11 



Note that lim e _> a = 1 and lim e ^ 1 a = ^/(l — k)/(l — k im ^ +1 ) = N 1 ^ 2 . The infinite-size limit 
exists only when ek < 1, and it is equal to 

lim a = )~ ek . (S.32) 

Appendix D: Target patterns in continuous media under 
spatial block noise 

We show that our results for the coupled oscillator system in the d- dimensional lattice are also 
valid for that in the continuous Euclidean space. We assume that Gaussian spatial block noise 
is applied. This type of noise has been used in experiments [32] . 

We consider the d- dimensional nonlinear phase diffusion equation given by 

d t <j>{r, t) = u + uV 2 (j) + y, (V0) 2 + s(r), (S.33) 

where r G M. d is the spatial coordinate, u > is the intrinsic frequency, v > is the diffusion 
constant, and \x > is the coefficient of the nonlinear term [TTJ. The term s(r) represents the 
localized heterogeneity, which is positive near the origin and vanishing otherwise. 

The synchronous solution corresponding to the target pattern is written as 4>(r, t) = Qt + 
ip(r), where Q and ip{r) satisfy 

fi = w + i/VV + MW>) 2 + s(r). (S.34) 

Let x(r, t) be a small deviation from the target pattern defined by x = <ft — (Qt+ip). Linearizing 
Eq. (IS.33P using x(r,t), we obtain d t x(r,t) = Cx, where the linear operator £ is given by 

Cx = zA7 2 x + 2fi (W) ■ (Vx) . (S.35) 

We define the inner product as 

[xi(r),X2{r)] = / drxi(r)x2(r). (S.36) 
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We define the adjoint operator & as [xi,Cx 2 ] = [tfxi, x 2 ], i.e., 

C)x = uV 2 x - 2/iV • (zV^) • (S.37) 
Note that £ is self-adjoint when = 0. 



Because of the translational symmetry in Eq. (IS . 33 j) with respect to (j), C has one zero 
eigenvalue. Let the right and left eigenfunctions of £ corresponding to the zero eigenvalue be 
u(r) and v(r), respectively, i.e., Cu = and C^v = 0. Trivially, u(r) = 1. The normalization 
condition [v(r),u(r)] = 1 then implies that J drv(r) = 1. 



Now, we introduce the perturbation to Eq. (IS . 33 j) as follows: 

d t <j>{r,t) = u + uV 2 (f) + fi(y4>) 2 + s(r) + ^D^r,t), (S.38) 

where £(r,t) represents a weak perturbation to the target pattern. Similarly to Eq. ()3]), we 
decompose x into 

x(r,t)=y(t)u(r)+ p(r,t), (S.39) 
where y(t)u(r) is the collective mode. The dynamical equation for y is then obtained as 

y = y/D j ' drv(r)£(r,t). (S.40) 

Let us assume that £(r,t) is the Gaussian spatial block noise characterized by 

£(r,t) = &(*), reR d (£), (S.41) 

{U(t)U'{t')) = 5 t , t ,C{\t-t'\), (S.42) 

where i is the vector index for the block ~R d (£). Using Eq. (IS .41 j) . Eq. (1S.40p is transformed 
into 

where 

v t = j drv(r). (S.44) 
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From Eq. C IS .43 j) . we find that the intensity of the collective fluctuation is given by 



Note that vg satisfies the normalization condition as follows: 

V^ = V / drv{r) = [ drv(r) = 1. (S.46) 
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Figure 1: Schematic of (a) directed scale- free network, (b) directed chain, and (c) directed 
two-dimensional lattice. The numbers in (b) indicate the indices of the nodes, while those in 
(c) indicate the layer index. 
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Figure 2: (a) Scaling exponent (3 for a oc in scale-free networks with 7; n = 7 out . The solid 
line is the theoretical prediction given by Eq. ( 1161) . The open circles are obtained numerically 
as follows. For each network, we calculate the eigenvector v to obtain a. Then, /3 is determined 
from the best linear fit between (3 and N on the logarithmic scale, as described in (b). (b) 
Determination of /3. Data points are generated as an average value of for each of N = 100, 
200, 400, . . ., 12800. The results obtained from the direct numerical simulations are shown by 
circles. For demonstration, the results for 7 in = 7 out = 2.05, 2.5, 3, 3.5, and 4 are shown. By 
assuming a oc N~P, we regress logo" against logiV by the best linear fit (solid lines). The slope 
gives an estimate of — /3. The Pearson correlation coefficient is large (> 0.99) for each value of 
7 ou t analyzed in (a). 
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(a) one-dimensional (b) two-dimensional 




Figure 3: Collective fluctuations for (a) the directed one-dimensional chain and (b) the directed 
two-dimensional lattice for various N and e. The solid lines and the circles represent the 
theoretical and the numerical results, respectively. In (b), £ max is the maximum distance from 
the center of the lattice. For both networks, we set Di = 1 (1 < % < N) and simulate Eq. ([I]) 
with the initial condition Xi(t = 0) = (1 < % < N). We measured a as the standard deviation 
of x(t = 10200) — x(t = 200) obtained by conducting 2000 trials, which is then normalized by 
V10000. We disregard the first 200 time units as transient. 
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(a) one-dimensional (b) two-dimensional 
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Figure 4: Collective fluctuation for coupled phase oscillators in (a) directed one- dimensional 
chain and (b) directed two-dimensional lattice. The solid lines represent the theoretical results, 
and the circles represent the numerical results obtained by the direct numerical simulations of 
Eq. flUD with f{4>) = sin0. We set A = 0.01 (1 < % < N) and start with x { = (1 < i < N). 
We measure a as the standard deviation of x(t = 10200) — x(t = 200) obtained by conducting 
2000 trials, which is then normalized by V10000. 
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Figure 5: (color online) Numerical results of the coupled oscillators on the two-dimensional 
undirected lattice, (a) Snapshot of sin</>j and (b) eigenvector v (log scale) for Aw = 0.3, where 
r\ and r 2 denote the spatial coordinates, (c) The dependence of a on system size N. 
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